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IN CISPUS 
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A ChecklisF and 
an Evaluation Plan 



1972-1973 
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General Plan 



Which of the follcwlng general types of purposes do you wish to serve by bringing 
your group? Please mark as many as apply: 



A 


/ / 
i, / 




n • 


LJ 


xeacner x raining 


B. 


£7 


Outdoor Education 


I. 


n 


Improve Relations & Communications 


C. 


£7 


Science Education 




u 


Between Generations 


D. 


U 


Improve Intergroup Relations 


J. 


Individual Enrichment 






and Communications 


K. 


u 


Individual Maturation 


E. 


n 


Recreation 


L. 


u 


Child Study 


F. 


£7 


Survival Training 


M. 


u 


Other (please specify) 


G. 


n 


Humanities Education 









2, Who will be the person — 



3. What dates are you thinking of? 

On 

On 



responsible for making planning decisions? 

responsible for directing the group while 
they are at Cispus? 

responsible for collectin evaluation data? 
responsible for arranging transportation? 
responsible for conducting the program? 



or On 
On 



beginning, arriving at around 

leaving at around o'clock, 

beginning, arriving at around 

leaving at around o'clock. 



o'clock. 



o'clock. 



4. About what sizes will' your sub-groups be? 



adults 

about 

about 



years old 
years old 



5. What kind of transportation do you plan to use to and from Cispus? 

/ / District Buses Chartered Buses U Private Cars 

* Until and unless we are notified otherwise, we will communicate with this person 
about arrangements. 



J) 

Superintendent 
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SUGGESTED EVALUATTON STEPS TO BE CARRIED 
OUT BY THE TEACHER TAKING A GROUP TO CISPUS 


RIGHT NOW 
this percent 
of my class 
is there. 


RIGHT AFTER 
Cispus this 
percent of my 
class is 
there . 


A. Decide your class' goals for going to Cispus. 

B. Break the goal8 down into abilities, tendencies, and 
memories (experiences). The "Teacher's Taxonomy" des- 
cribed in the accompanying booklet is much simpler than 
Bloom & Krathwohl's and should be helpful to you in 
carrying out this step. 

C. Enter those in some of the blanks under "Objectives" below 
(perhaps 5 to 10 of the 21. List more than 3 under any 
category you wish, of course) . 

D. Determine where each of your kids is on these "objectives". 

E. In the column next to this one — "Right Now" — show 
about what percent of your class has already achieved 
each of the "objectives" you have identified. 

F. > Share this with other teachers. 

G/ Plan, and p-^^pare to determine, where each of your kids 
will be right after Cispus (then you'll really have 
objectives) . 

H. With other teachers, plan to move your kids to your 
objectives. 

I. Right after Cispus, carry out those "G" plans, and 
record the results in the last column at the right. 






OBJECTIVES* 

1 To Know — 

i ^• 






1 2. 












w To Understand — 

M 

1 






3 -1^ , 






1 3. 






} *Be Able to — 
! 1. 






! 2. 






• 3. 







* Actually, these are not complete "objectives" until you add expected levels for 
"RIGHT AFTER". 
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TEACHER'S OBJECTIVES (Cent.) 


RIGHT NOW 
this percent 
of my class 

is there. 


RIGHT AFTER 
Cispus this 

percent of my 

class is 

there. 


} Be Interested in — 
I 1. 






1 2. 












w Have a Habit of — 

u - — — — . ^ 






as 2 












{ Have Che AcclCude of — 
! 1. 






i 






3. 






1 Have had the Experience of — 

cn 

W 1 






en 

§ 2. 






S3. - 
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AT THE END OF EACH DAY AT CISPUS 
Teacher/s' Log* 




Date 



Ugh! 



o 
o 
o 
o 
o 



Wow! 



1 

0 




• 

2 


• 

3, 


J 

4 


.1. 

5 


1 




t 


1. 


■ 


• 


0 




2 


3 


4 


5 


.1. . 








-L- 


L 


0 




2 


3 


4 


5 


f 




• 


• 


_j — 


, 


0 




2 


3 


4 


5 


- 




• 


... ^ ^1. . . 


_i 


1. 


0 


1 


2 


3 


4 


5 


Ln circle after activity 




see 


for 


each 


was 


[please enter 


on 



scale after activity]: 

The three best features of the day were: 

1. 

2. 

3. 



Our suggestions as to how the day could have been more profitably managed are: 



/ Teachers 
[Please wtite any minority 
6n 



opinion pn back. ] 
* To pe filled out by a triad 



of teaij^rs. 
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Teacher at Cispue 



/ 
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KIDS' EXPECTATIONS 
UPON ARRIVINH AT CISPUS 

[Select randomly and interview one out of five kids] 

Please record here, in writing, or on the tape with your voice, the answers to these 
eight questions. , 



/ 

/ 1. What is the date today? ' What school are you 

from? , 



2. Have you been to Cispus before? What was the best experience you 

had at Cispus before? - 



3. Have you been away from home without your parents before? 

4. What do you expect to do while you're at Cispus? 



5. What do you expect to like most? 



6. What do you expect to like least? 



7* How much part did you have in planning what you are going to do here at Cispus? 
(Circle the appropriate cross.) 



I had I had a I had some I had a I planned 

no part little part part (about large part it all 

my share) 

8. Guess who, from among your group, we are talking about when we say: 

This one is always happy ^ 



This one is always worried 



This one is the hardest worker 



This one is the smartest out of class 

This one is the best leader 

This one can't take a joke 



This one is always picking on others 
This one never likes to do anything ^ 
This one has' the most friends 



This one has the fewest friends 



You would most like to sit next to him or her 



You would most like to work on a class project with him or her 
You would most like to have him or her as your friend 
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|r%DS' CLOSING i|sSESSM6NT 
UPON LEAVING jciSPUS 
(Select randomly and Intervlej; one out of five kids*] 



Page / 



Please record here, In writing, or on the tape 
eight questions: ° 



with your voice, the answers to tAese 



1. 


What is the date today? 


1 ' 


2. 


What school are you from? 


r • T ■ 


a. 


Who Is your teacher or 'group leader? 




4. 


What were the three best things thal^ 


happened to you while you were at 




Cispus this time? | 


» 


1- i 






% . ^ 






]■ ' — I 

>• L. 





5. What experience^ did you have which 



you had never had before? 



6. What were the v^rst things that haf^pened to you while you were at Cispus 
this time? 



7. What would you suggest to make visits to Cispus better? 



8. How would you rate your experience at Cispus on this scale? 

Ugh! Wowf 

J 1 1 I I L. 
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A PARENT'S EVALUATION 

Naae^ ninber or 

OF HIS CHILD'S CISPUS EXPERIEHPE Identifying mmtk 



[a month or two later] 



A month or two ago your child went to Clapua for a ahort tine. have atteapted to 
asseas the value of that experience In many waya, and now we would like to complete 
our evaluation by getting your neraonal opinion of the effect that the Clapua 
experience htfd on your child. *^ \ 

It nay be that you do not believe that the Clapua experience had any laatlng (until 
at least now) effect. Or, It may be that you think the experience* changed the 
entire courae of hla life. We bell^eve that a statement of your Iroreaaiona and 
beliefs regarding the Clapus experience will, to the extent that It la a full and 
candid statement, help ua to make the future educational experiencea of your children 
and the others in this school r^lcher and more valiiable* 

The following "stems" are provided merely aa possibly helplEul Jogs to your memory: 
1. At Clspus, for the first time in his/her life, he/she (did) 



2. At Clspus, he/she- learned t;hat 



3. Because he/she went to Clspus, he/she now is able to 



4. Before she/he went to Clspus, she/he (did) 



, but now she/he (does) 



5. Because he/she^ went to Clspus, he/she now understands 



Note: Pleaae use back of page to continue commentary whenever neceaaary.« 
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■valuator III 



A TEACHER' S TAXONOMY 
OF LEARNING OUTCOMES 



by 



Or. Barry W. Johnson 
Supervisor, Program Evaluation 
Suparlntendent of .Public Instruction 
fe. Old Capitol Building 

Olynpia, Washington 98504 . 



Presented at the First /Annual 
PACIFIC NORTHWEST RESEARCH AXD EVALUATION CONFERENCE 
Sea-Tac Motor Inn', Seattle, Washington 
May 11, 1973 
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A TEACHER* S TAXONOMY OF LEARNING OUT(X)MES 



This presentation is, basically, a &et of definitions — a matched set. 



actually. It is also a closed set. I think. That is ay hope. 

Some of you are probably perfectly happy with the term "learning outcomes." 



To them, l^t me say, "Thank you. I'll be right back." To the others, who 
presumably would like to know where I'm coming from when I use that term, I 
offer k list of seven preliminary definitions. I hope you like them. But 
howftver that may be they are intended to spell out what I shall mean by these 
common, basic terms as I use th^ in discussing the definitions I came here to 
talk about. 

First Definition: Human behavior is any and every kind of thing which 
people do. This includes: blinking, humming*,, reading*, walking*, swallowing, 
perspiring, digesting, talking*, driving a car*, responding emotionally, draw- 
ing a picture*, and twitching, all of which a good behf^orist could observe. 
It also Includes Imagining, visualis^ing, doing mental arithmetic*, analyzing*, 
contemplating, .wishing, feeling an emotion, feeling a pain, enjoying, relating 
to previous experience, summarizing*, tasting, dreaming, deciding, and other " 
things which ca nnot be observed. 

Second Definition: Learned human behavior is that aspect of human 
behavior which, has been modified by the learning process. This Includes at least 
some of the items included in '*human behavior," above, to wlt...*M items. 




'bird Definition: The learning process consists of three steps — 



Responding in some way to some set of states and stimuli. 



(2) Experiencing a 



"reward"*. 



*rtductlon in disequilibrium, really* 



-2- 



(3) As a consequence , being more likely to respond in about the 
same way the next time one experiences about the same set 
of states and stimuli. 
Fourth Definition: Any bit of learned behavior has two aspects or 
dimensions which may be modified by the learning process: 

(1) Effectiveness ~ the extent to which it rewards (see footnote, page i) , 
«and (2) Incidence — the frequency with which it occurs under 

various circumstances. 
Fifth Definition; To change the effectiveness of a person's behavior 
is to change Ifls ability — i.e., to modify one of his abilities . 

Sixth Definition: To Increase or decrease the incidence of .a^«rson*s 
behavior under any given set of circumstances is to change a behavioral 

tendency in him — i.e., to modify one of his tendencies * 

Note: This may be the incidence of a kind of 
behavior which has also been increased in 
effectiveness ; these are two dimensions or aspects 
of the same behavior «^ However, we choose to say 
that two learning outco^les have been generated in 
such cases. 

Seventh Definition: Modifications of abilities and tendencies are 
learning outcomes , and all learning outcc»&es are either modifications of 
abilities or modifications of tendencies. That is, we choose to ignore 
modifications of other dimensions of human -behavior (whatever they may be!) 
in discussing leaxrning outcomes. 

In a manual for teachers going to Cispus Environmental Learning Center, 

I put it this way — 

Learning can change behavior in Just two positive ways ~ 1) it 
can make one able to do scnne thing he couldn't do before, or 2) it can 
make one tend to do something he didn't tend to do before. These are 
both, of course, a matter of degree; one is more able to do something 
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or one has more (or less) of a tendency to do scH&ethlng. Consequently » 
any learning product may be stated <and rated) in one of the following 
forms : 

Form A. He is able to bisect an <xn gle (Skill) 

^ " 

to this degree: { J f J ^ 

not at perfectly, 

all or as veil 



or 

Form B. He tends to check his work (Habit) 



as anyone 



to this degree:' 2 i ? } J 

not at - all the time 

all or whenever 

^ possible 

Dividing all learning products into these tvo types h^ certain 
advantages over use of the taxonomy of Bloom aiki Krathwohl (Taxoncaay 
of Educational Objectives , N.Y.: David HcKay Co., Inc.)« In the first 
place, lt*s simpler (althoi^h Form A and Form B can be sub-divided and 
8ub*^sub**divided) • In the second place, it deals only with directly 
observable behavior by either an objective observer, a subjective 
observer, or both; no inferences or Freudian flights of interpretation 
are necessary. 

The basic dichotomy may be further clarified by observing that 
abilities (Form A) are ordinarily measured by tests, whereas tendencies 
(Form B) are ordinarily measured by inventories. iQ>ilities (Form A) are 
thought of as how one does when he does his very best. Tendencies 
(Form B) are thought of as how one does typically "or on the average. 
Abilities (Form A) include knowledge, skill, and mder standing. 
Tendencies (Form B) include interesffs, attitudes, and habits«* 



One point in subdi'^idlng the types of learning products is that the 
different sub- types are taught in different ways. The teacher planning 
learning activities needs to take the differences Into account. For 
example, if the teacher wants her clkss to "learn about" testing water 
for Impurities, one set of learning activities would help them efficiently 
memorize the steps involved (Knowledge), another would help them develop ' 
speed and accuracy in performing the analysis (Skill), and still another . 
set of learning activities would lead them to see why certain steps were 
taken in doing the testing (Understanding). VAiich are you after? You may 
well be after all three. Then all three Icinds of learning activities need 
to be included. 
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For whoever is Interested and for whit it's worth, a section on 
**Arranglng for Learning to Happen" is presented in the Appendix in 
the hope it may be helpful* * 



The other main point in subdividing the types of learning outcomes is 
that the different sub-types ate assessed in different ways. In an assessmnt 
of understanding or knowledge, time is virtually irrelevant. In an assessment 
of skill, it is crucial. In an assessment of knowledge, the problem must be 
familiar In an assessKnt of understanding, the ^iroblem must be unfamiliar. 
Etc. A habit must be assessed in certain specific circumstances. An Interest 
mmt be assessed in a variety of clrcuutances. In assessliKg an attittkle, the 
Intensity of feeling becoa^s a critical dimension, and an objefct of the attitude 
is involved. 

So, how may the various outcomes be distinguished? As I suggested earlier, 
the first step in sorting learning outcomes into the categories of the Teacher's 
Taxonomy is to decide whether the outcome is an ability or a tendemiy. The^^ ^ 
collaition below may help. 

Characteristics of Two Major Types of Learning Products 



ABILITIES 



TEKDENCIES 



Hay be described by saying: 

define "tangent^* 
Learner is able to (Kncwledge) 



to tills degree j_ 



1 

_!_ 



2 
t 



3 



May be described by sayina: 

make aeaign with a ccmpaaa 
Learner tends to (Interest) 

0 1 2 3 4 
to this degree j 



not at 
all 



perfectly, 
or as well 
as anyone 



not at 
all 



all the 
time or 
whenever 
possible 



he couldn't, before learning 



he didn't, before learning 



usually assessed by using tests 



usually assessed by using inventories 



assessed when he's doing his best 



assessed when he's behaving typically 
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Once this basic decision is reached, further sorting may be facilitated 
by the following hints and clues: 



hrl If the objective proves to be an ability, the quCHtlon remains 
whether it Is an example of knowledge, understandii^, or skill. 

ArZ As already suggested (in Table 1, page 8) if the ability involves 
the execution of a series of two or more steps and/or a pattern 
* of sijiultaneous behavior eletoents (as in serving a tennis ball), 
the ability is a skill. 

A-3 If no such series or pattern is involved, and the ability involves 

"^seeing** or ''dealing with*^ some relationship. It is an understanding* 

A-4 If, however, the ability involves nerely resieabering the appropriate 
response, 1^ is an exasple of knowledge. 

Table I should further clarify these distinctions. 



wl^ther it Is an exaiq>le of interest, attitude, or habit. 

11*2 If a feeling or eaotion dimension is involved, the tendency is 
an attitude. It will prove also to have an object — irfiatever 
arouses the feeling or erotlon «^ and a characteristic response 
to that object.* . \ 

If the tendency has ik> eootional or feeling dlnension and r«uires 

no conditions except an opportunity to sianifest itself, it is an 

# y 

Interest. Interests, of coarse, aay conflict or be thwarted .j 

B-*4 If the tendency appears only in certain circuMStances or under 
certain conditions, it is a habit. \ 

Table II should further clarify these distinctions. 



*Knowledge differs from this both In that it is under control (voluntary) and 
it has no emotional content* 



A - ABILITIES 



B - TENDQICIES 



B-1 



If the objective proves to be a tendency, the question remains 



ERIC 




-7- 



r 



ERIC 



u 

a 

-I 

mm* 

• SS 



V 

e 
ft* 



0 • 



o a 



M m . 



C TV 

o M « 



£ • v» 

c 

M >« 

a* ^ 

c « c 

o «• I 

« 5 



coo 
m •* jz 

Own 

^ ^ ^ 

• ex 

m 9 

w w « 
ft« d 
O m 

« a M 

O CL 











II 

• 


u 
m 

«4 • 

«4 0 

li 


O 0 
B 

« ^ 

2iS 


to 

.:2 



m 



• u 0 

• « •«« o 

^ X <^ 
ft* « 9 *» 

O «•« • CI 

W «•« P<« « 0 « 
«i40^0%« 

0 • 0 ^ «4 0 

««-0^ ^0W4««« 

M0N «03«4W 

OMM 00O>0 

W03 04lia««0 

0 X a X 0 «» 

ti U to 

ccccc<««c *^ 

«««4<«««««««J:«4 toti 

Ti-0j« » >»<i^ 0 e 

00M««W«X0 

«0Qto-«00«« 



c 

38 



2 



a 0 

O 0 

«^ to 

• 0 

> M 

St * 



e 0 «4 

-I § 

U M to 

ceo 
0 •«« a 
TI X a 0 

C M o 0 
0 0 0 
M ■ 0 ^ 

^ O X to 

< 0 W 0 



B 
O 



X w 

0 O 

to 0 

^ to 



C 3 



to u X 0 

I C w X 

IM 0 » 

^ 4« -0 <M 0 

0 0 6 0 0 

0X0 T» 

0 44 (k^ 3 

fi O 0 «i>« 44 

• C T9 0 

W C TI to W 

0 C 3 C 0 0 W 

3 0 »4 « w 3 « 
to a 0 C ^ 

I- O > 1-4 O. 

« « « « 



^ > to 
3 to W 



O 0 0 

W 0 XC 

K O^ 

6 



55 

0 ^ 

to 

w 0_ 
W 0 to U ^ 

< to S 0 0 



0 -O C 0 ^ 

2 O 0 to 
0 &4i • , 



19 



^ to 
0 c 



I X 

I o 
B 

I 3 



U 0 

S X 

s 



I 0^ 

> B 3 



w to «i>« to 



0 0 



I B 

: e •*« 

I -p* 6 

> U 0 

M ^ to ^ W 



to T9 ' 



O •*« 

2 



I O >« 

o 

' X > 

U O 

0 ^ 

C 0 

0 o 

X 0 

W «J TI 

«4 to 

to TI O 

0 TI O 

0 0 0 

C to 



X c «• c « 

0 ^ C <^ C 
^ X ^ 
J< <l M 
to « 

«• U S 



: s 

0 B C 

SIS 

••4 3 to 

•0 ito 

0 to IK 

5 " - 



0 X • 

CX 0 . 
0 3 



C TI 0 

^ 0 

X o a 

2^5 



Is 



0 >H 0 

iO X 
6 M 0 



w 0 to 



• 



Eimim cisFus d(perience 

Part One: Teachbi's Kbmbook 



A Plan 

Which Teachers Hay Find Useful 
And an Explanation o£ 
The Teacher^ 8 Taxonomy 
Upon Which the Plan is Based 
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EVAUUATING CISPUS EXPERIBCE 
Part One: Teacher's- Handbook 

INTRODUCTION 

1 

What happens to a kid who goes to Clspus? Clspus Is different from his 
hone, his school, and his neighborhood. His e!xperlences at Clspus are different 
'froK any he's had before, and the effects are different from 'any he's undergone 
before* Our problem Is to evaluate those effects. 

The problem Is made easier by certain advantages. First, the ''Clspus 
experience^' la ^sy to define. We can state quite clearly that we are Interested 
In the effects of the experiences the youngster has between the time he enters 
the "^^ampus" and the time he leaves. 

Second, the experience Is relatively short. Consequently 

a) results are not badly confounded by the effects 9f *"noxmal growth 
and development." If the youngster had not come to Clspus, little 
"normal growth and development" would have taken place in just a 
few days. 

b) data Is still relatively fresh in everyone's mind, whether it be 
that of the evaluator, the child being studied, or another observer 
of the child. 

And third » the experience is continuous. The child does not alternate 
Clspus and non-Cispus experiences (as he does school and non-school experiences), 
^. and thus more confounding is avoided. 

Another advantage we enjoy in evaluating the Clspus experience is inherent 
in the fact that taking kids to Clspus entails trouble and expense. That is, 
•\ we may assume with 8<xne confidence that whatever results are achieved at Clspus 
mafhe credited to Clspus, since the staff would have achieved those results in 
an easier and/or cheaper way if they had seen how to do so. 

In short, we are saying that we may evaluate a student's Clspus experience 

by assuming that all changes In him from the time he gets there until the time 

he leaves may be credited to Clspus- and then assessing those changes in the 
best way we can. 
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Our approach in suggesting what coasider "the beat vay ve can" asaeaa 
the changea which take place at Cispus will be to preaent a daaalf Ication 
achcaa for learning products called the Teacher's Taxonowyy and a set of care- 
fully apalled-ou^ approaches and steps based upon that Taxonomy. The approaches 
and steps — and /the Taxonoiby — nay be used to evaluate learning products; 
by anyone Interrated in the products of learning. But^before we present then^ 
na should consiaer one m>re special feature of the Ciapus experience axul the 
•valuation technique that feature suggests. 

BMauae Ciapua is as umiaual as it is^ many of the experlencea the youngster 
has there are "firstip" for him. The best authority we can consult about a child* a 
"firats" is the child himself. Consequently we should use student self^reports in 
studying these "firsts." Because they are "firsts t" Thomdike's good old Laws of 
Learning would suggest that they will be clearly remNd>eriMl not only because 
of their Recency » but also because of their Primacy and their IntenslRty. We 
■Ight b«8t use soae such open-enled que«j:ion as 

At Cispus, for the first time in «y life I (did) 

^ T-^- / • 

Unless we can be sure that writing fluently is easy for the chiUlt ^ should 

present this iton to him orally and record his respraaes on tap4t if we want 

the fullest kind of data. In any case^ whether his response is written 

oralt the da^ from open^exded questions is sometimefydlff Icult to analyze. 

In the Evaluator's Handbook > Section III^ we deal with that prohlem at scnae 

length. The Interested teacher may wish to obtain a copy.^Ntow^ however » ^et 

us turn to Three Approaches to Evaluating Learning. 

THREE APPROACHES TO EVAmATIMG LEARNING 

The Evaluator aeeking to identify the products of an individual's learn- 
ing eaqperience hasy basically » Just three avenuea open to him: 

1) Be may ask tuc learner himself about his behavior before and 
after the learning experience^ 

2) Be may ask others who have had an opportunity to observe the 
learner's behavior before and after the learning experiei^e^ 

or 3) Be may observe the learner* a behavior himaelf • 
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UtlMir ttandiirdiscd (and comercially published) or imstandardlased techniques 
mipr he used in any of these approaches. For the standardised techniques » thm 
•Italuator is referred to ^ros* Mental Measurements |earhook (Nev Brunsvick» 
Mefv Jii;sey; Rutgers University Press). %amm unstandardized, techniques are 
utilised in the Guidelines and .others will be suggested in our discussion of 
* subjective reports in the Evaiuator's^Haitdbook. 

By' "others** in the above we man to suggest here (a) other students »^ ^ 
(b) student leaders » **big br6t)^rs»** €ftc.» (c) other staff MSibers» and 
(d) parents ^ -whoever' has -been in thg^best position to observe chanlges between 
the youngster *s behavior before Cispus (or sosm evebt at pispus) and his^ 
hehavlor after Cispus (or som iivttt'^at Cispus). SliK:e we ofm canMt assuM 
that this %tl(er" observer has any special tralnliM^'or expertise in observing » 
. we can expect from him only such data as he can ^oUecf^th the simple ins true- , 
tlons we, give. him. For example^ we might ask m»ch an open-ended question as 
**Have you noticed any changes in ^our child's behavior 'Sli^e he was at ClspuiA 
If so» please describe them.** Or wtf might ask a staff mesber 'td rate the 
yoimgster on a scale. Or .we might ask the entire class a soclogram-type ques* 
tiou' such as» **Do you feel that since you came to Cispus you can communicate ' 
better with certain people? If 80» who are the three with.«vhflii your communica- ' 
tlon has improved the most?** • * ' 

Im noting changes ourselves » we may use ourselves Just, as we would use 
**others** in the foregoing paragraph^ or we iaay'use techniques involving more 
expertise^ rating the child on spedf'lc aspects of Intellectual or social 
growth^ mastery^ understandli^» skili« behavj<ural tendencies^ etc. 

Rating his behavior and* for that matter » deciding what kinds of behavior 
- to rate will be made easier hy first considering a classification scheme for 
learning products. This Is the Teacher's Taxonomy. 

. / I 
A TEACHER'S TAXONOK? 

Learning can change behavior in just two positive ways 1) it can make 
one able to do something he couldn*t do before, or 2> it can make one teiut to 
do something he didn't tetMl to do before. These are both, of course^ a matter 




of dftgrM; one It matm able to do soMthlng or one has aore of a tendency to 
do ioftithlng. Consequently, any learning product nay be stated (and rati^) In 
one of the follovlns forms: 

Fom k. Be Is able to ' 



to this degree: 



or 

Vom 1. He tends to 



0 



1 



2 



not at 
all 



3 



perfectly, 
or as veil 
as iuqrane 



to this degree: 



0 



1 



m>t at 
aU 



2 



3 

X. 



all the tSm 
or fHien s f^ e r 
possible 



Dividing all learning products into these two types has certain i^antages 
over use of the taxonovy of Blocxt and Krathwohl ( Taxonomy of Educational Objectives , 
S.T.: David McKay Co., Inc.X In the first place, It^s sljspler (although Fom A and 
Vom B can be sub«-divld«t and 8ub«-sub^lvlded| • In the Mcond place, it deals 
only iflth directly observable behavior; no Inferences or Fr^dian flights of 
Interpretation are necessary. 

Tte basic dichotony nay be further clarified by observing that abllitlea 
(Ftorn A) are ordinarily measured by tests, whereas tendencies « (Fon B) are 
ordinarily neasured by inventories. Abilities (Fon A) ^re thought of is how 
one does idien he does his very best. Tendmdes (Form B) are thought of as 
how oM does tjrplcally or on the average. Abilities (Form A) include knowliMlge, 
skill t and understanding. Tendencies (Fom B) include Interests » attitudes, 
mod habits. 



TWO USES FOR THE TEACHER'S TAXOHOKT 

The Teacher's Taxonomy is offered in the conviction that it can help a 
teacher Increase his effectiveness and save his tlms and energy at two points. 
1) Vhen he is planning a learning activity for one or wre students. 
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and 2) Mton ht Is eviilumting the results of the activity he planned. 
Certain steps are suggested for each of these tvo points* 

goiift I . When planning a lemming activity /*- 
Step m . Draw up a Big Chart* like this: 

Student is able to Student tends to 



/'V V 

^Mrattt 


(1) 
bisect 
an angle 


(2) 
define 
tani^t 


^.(«tc.) 


(1) 

check his 
work 


(2) 

make designs 
with ciMqMiss 


(etc.) 


I. 
2. 

etc* 

J 















The ^^etc/s" suggest that you nay well have nore than two 
students and you nay well want more than two coluaois each' under 



t is able to 



and "student tends to 



The rationale 



for naaing the column headings is on pages 3 and 4 (from **Rating his 
behavior*. •** to bottom of page 4). The eauuqiles would probably be 
best classified as ^ ' 



' bisect an angle skill 

define tangent - knowledge 

cteck his work - habit 
make designs with compass interest 

These are unusually succinct. * 



Step b e For each student » in each column /enter a rating (0 to 4), # 

grade, score » or evaluative tern to tell "where he is" now — before 

the planned learning experience* This Is also discussed in the 

section cited abdve* 
• 

Step t . Plan learning experiences for the' students which you believe 
will yield the desired learning outcomes* There are suggestions for 
such planning 9 compatible with The Teacher's Taxonomy > in the Appendix. 



^Instead of » or In addition to, this Big Chart, the teacher may wish to use the 
form provided in the Guidelines* 
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Sttp d . ¥lka how you vlll dfttftml&e *Siherc your •tudtnts are,** 
vlth regard to each coluu of the Big Chart » after the planned 
lemalng experiences. The techniques of Step b My be applied 
agaln^ 

^ Step e . Guess what the average score, rating, etc., vlll be or 
hov you will be able to sunnrlse vfaere your students are, after 
^ the learning esqperlence. Mrite It at the bottom of each coluan 
of the Big Chart. Tou now have a defensible set of objectives. 

Point 2 . VIbm evaluating thellK|sult of the activity ^ 

Step a . After the learning experience, assign each studei^ enother 
rating, score, or evaluative tern as soon as you have carried out 
your plan in Step d. Point 1. 



Step b . Average or otherwise suHOMriae the students' "final** 
ratings, scores, or whatever you have. Tou now have a suasative 
evaluation of the learning eiqperiences you planned. 

c 

/ ■ 

THE SDBDIVISIONS OF THE TEACHER'S TAXOliOMT 

Abilities, then, as stated by Form A (**He Is able to ...**), are coononly 
called by one of three names; 



a) Knowledge 

b) SfcUl 

^ , c) (hideirstaiullng 



Tendencies » as stat^ b^ Font B C'Be'^eods to •••**)., are consonly called 
by one of three other names • 

a) Interests 
b*) Attitudes 
c) Habits 

Ta[bleii I ai^II are designed to define, clar|.fy, and distinguish these 
various abilltiei and tendencies, respectively. ^^ 

One point in .subdividing the types of learning pfToducts is that ithe dif- 
ferent sub^ types are taught in different ways. The teacher plsnnii« learning 



activities needs to take the differences Into sccoiint. For en^ple. If the 
tMchar vsnts her class to **leam about^ testing wter J[or_iiipw one 
sat of learning activities vould halp them efficiently naiiorisi^the steins 
inrvolved (Knowledge) » another vould help the« develop spesd and accuracy in 
p«rforBiia« tha analysis (Skill), and still another eat of learning activities 
wold lead them to see why certain steps vers tstcen in doing the tasting (Dndar- 
standing). Which are yoo after? Tou aay nell be after a. I three. Then all ^ 
three klnda of learning activitlM need to be included. 1 

Cnq ne a tion ably, as a trained and experienced teacher you have already 
developed methods for plannii^ mad evnlnating learning* activities. Ihe fore-* 
fblQg is offered in the hope thst it nay be helpful and that your sojourn at 
Cispue nay be the best possible leeming experience for your ktds. 

Por whoever is interested end for.i4iat it* a worth, a aeetian mi **Arrangi]|g 
for Learning to Happen** is presented in the i^pmdix in the hope it nay be 
helpful. 
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mUBATnC THE EfgECTS OP LEAIMIIB EXPERIESCES 

Evalimtliig the eff^ta of 1— rning experlesices should be easy for the 
teacher vho haa f olloved the inatractiona o& iMgea 5^6. One aiaply looka 
at a child's acore frw hefore the leamlng experience ~ or at an average 
or ii J of a group* a performance before the learning experience and ' 
then lodka at the child* a acore or the group*a average or atanury after 
the learning ei^erience mad deteraiaea the difference. Thia ia especially ~ 
and dec^tively — eaay if all aeaaurea are taten vith atandardiaed (or at 
leaat "objectiva") tmtm. If it aatiafiea your needa of the Msent, by all 
■aans taiea that approach. 

Hauever, if you have difficulty undera tending and interpreting the 
r^mlta of open-ended qMationat free reaponaea, etc., and relating then to 
goala and objectivea atated in tema of the Teacher* a TrnMOoamj^ perhapa we 
can help vith aone practical hlnta and doea about aortlng out lea rning out* 
cones. 

soMnms OCT LEMamig ooicohes 

Aa we suggested earlier, the firat step In mrting learning outconea 
into the categories of the Teacher * s Taxonony is to decide vfaether the out- 
cone la an ability or a tendency. Table III nay help. 



Table III 

Characteristics of Two Major Types of Learning Producta 



ABILITIES 


TENDEHCIES 


May be deacribed by aayii^: 
Leemw ia able to 


May be deacribed by aaying: 
Leanmr tends to 


^ 1L4 A 0 12 3-4 
to thia dearee . « • • • 


^ ^ 0 12 3 4 
to thia dearee • t f f • 


not at perfectly* 
ell or aa well 
aa anyone 


not et all the 
all tine or 
whenever 
poaaible 


he couldn't, before learning 


lui didn't, before leamii^ 


uMally aaaeaaed by uaing teata 


uaually aaaeaaed by uaing inventoriea 


asaeaaed idmi he* a doing hia beat 

4:1 ' 


aaaeaa^ uten he* a bitoving typically 
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Once thl0 basic decision is reached, fttrther sorting nay be facilitated 
by tlia f oUoving faints and clues: 

▲ - ABILmES 

If the objective proves to be an ability, the question resalns 
idiether it is an example of knovledge, understanding, or skill* 

A-*2 As already suggested (in Table 1, page 8) if the ability involves 
the execution of a series of two or more steps and/or a pattern 
of slmltaneotts behavior elenents (as in serving a tennla ball), 
the ability is a skill* 

Ar3 If no such series or pattern is involved, and the ability involves 
'^seeing'* or **dealiiHI with** sons relationship, it is an understanding « 

Ar4 If, however, the ability involves nerely remember ing the appropriate 
response, it is an exanple of knowledge. 

B - TEHDESCIES 

B*l If the objective proves to be a tendency, the question reaains 
imether it is an example- of interest, attitude,, or habit. 

B»2 If a feeling or eaotion disension is involved, the tendency is 
an attitude. It will prove also to have an object — whatever 
arouses the feeling or eaK>tion ~ and a characteristic response 
to that object.* 

S-3 If the tendency has no enotional or feeling dinension and requires 
no conditions except an opportunity to nanifest Itself, it is an 
interest. Interests, of course, say conflict or be thwarted. 

B-4 If the tendency appears only in certain circusstances or under, 
certain conditions, it is a habit. 



^Kioirledge differs from this both in that it Is under control (voluntary) and ' 
it haa no esotional content. 



II. 
III. 



foregoing hints are not sufficient help» you should turn to the 
Handbook . The Evaluator's Handbook contains the folloiiring sections: 

Soae Definitions 

A. Goals and Objectives 

B. Outcoaes 

C. Mcnories / 

A Classification Scheme for Data on Learning 

Subjective Reports of Other Learning Outcones (besides Meaories) 

^ A. Re Knowledge 

' B. Re SkUl 

C . jte Uiuler standing 

D. Re Interej|t8 

E. Re Habits 

F. Re Attitudes ^ 
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APPENDIX; ARRANGING F OR LEARNING TO HAPPEN 

A poverf ttl "teachlnR technique" for helping students acquire knowledge 
(m it Is defined here) can be derived directly from the definition In Table I 
^ and fron what ve know of relnforceaients and r wards. The teacher must so 
arrange events that the learner 

a) receive the "simple stimulus" (like "What is the capitol of 
Wyoming?"). 

b) be led or helped to make the "correct simple response" (like 
**Che7enne"). 

c) iMiedlately receive reinforcement or reward (like knowing his 
answer is correct). 

IfTOj^mr use of flash-cards provides this arrangement of events. 

Another powerful "teaching technique" for knowledge Is the use of mnemonic 
devices^ as refined and described^ for example, by Barry Lorraine In his book» 
How to Develop a Superpower Memory (New York: Fell, 1956) . 

This a m s ? s 1ng lypproach has been us€4 by show-business people for centuries, 

but has rarely achieved the respectability of classroom use and instruction. 

I 

' piping learner's gain understanding can also be described in very general 
terms, when understanding is defined and understood as set forth in Table I. 
When the teacher has identified the "relationship" the learner needs to "see" 
or understai^, the following experiences must be arranged for the learner. 

a) the learner must observe the relationship obtaining under a variety 
of circumstances, 

b) the learner mijst test the relationship he thinks he sees, 
and c) he must have his theory (hunch) confirmed. 

. To .practice what we preach, let us give two or three examples. 

Exsmple I 

e) learner observes that wi^enever he yells, his mother picks him up, 

b) learner thinks he understands his mother's behavior; so the next 
time he gets bored he yells, 

aad c) his mother picks him up. 
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EMKple II 

a) iMrner observes that anything under water — including hlAself 
aacM to be considerably lighter than It Is out of water. 

b) learner tried to pick up a large rock under water » 
and c) he can. 

EMMpia III 

a) learner notices (with some guidance) that **cat»" ^'car^'* and "can*' 
not only have the sm» letter at the left but also b^in with the 
sane sound. 

b) the next tl»e the learner encounters "c'* at the beginning of a 
wordt fortunately 9 it is in the word "cap** and in the sentence » 
**Ha put his cap on." Reading the sentence » he tries his hunch 
about "c** at the left end of a word. 

c) the sentence makes sense. 

Of course in all of these prescriptions for nanaging learning we are 
ignoring at least two important and closely related considerations. Firsts 
the learner must be motivated in order either to respond to stisa:!! and situa*- 
tions or to feel rewarded or reinforced. Second » fate is constantly arranging 
these learning clrcuastances in various combinations » and learning goes on 
willy nilly, consciously and unconsciously » all the time. 

Helping learner's gain skill as defined in the Teacher's Taxonomy has 
been spelled out in great detail.* We shall give here the bare steps: 

1) Learner sees the objective (perhaps by demonstration). 

2) Learner receives demonstration and/or explanation (perhaps in 
slow motion) • 

3) Learner tries it. 

4) Learner evaluates his performance. 

5) Learner repeat^Steps 3 and 4 a number of times » each time striving 
« to eliminate aspects of performance which Interfere with improve- 
ment and retain those which Increase it. 

6) Learner graduates to greater and greater challenges and higher and 
higher levels of performance. 

»Harry W> Johnson. "Skill » Speed x Accuracy x Form x Adaptability," Perceptual 
and Hoter Skills, 1961, 13, 163-170. 
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A yfUbU •t ratty for fosf ring a habit may be sMn froa the definition - 
"« tendency to behave in a certain way under certain drcuMtancea." If you 
%mild Instill a habit In a student you must be able to arrange that, for as 
long as It takes: 

a) he be r«dnded to carry out the desired behavior whenever }m Is 
under those "certain drcuastancest" and 

b) he Instantly get sosms revard or satisfaction (If only a check- 
aark on a chart). 

A "casiplng*^ situation affords the 24*hour supervision idilch Is so helpful 
In asking such arrangeasnts. Other non-school habit foraatlon is auch aore 
difficult. 

Tlie developaent of Interests can be very frustrating unless one takes Into 
account the coaplex bases of Interests. Soae are directly Interesting (the 
learner enjoys the> process) , but soae are indirectly interesting (the learner 
vants the product of the activity * incltkling such products as Mney). Soae 
activities are interesting to the learner on an individual basis, soae on a 
social basis. Hence , the rewards (and the incentives) «dilch control interests 
aay be grouped into four categories. 

Table I 

What Rewards Cause a 
Learner to Engage in an 
Activity (i.e., have an "interest"')? 



Type of ^ 
Basis 4^ 


Direct 


Indirect 


Individual 


He enjoys the 
physical act. 


He values the 
product itself. 


Social 


Be enjoys the 
associations 


He values the 
aeabfrship, 
prestige, etc., 
yielded. 



In order eo fully control an Interest » one moat eaploy the factors Indi- 
cated in the table. Using the wrong one(s) will lead to nothing. 
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yo»frlmt attitttdt Is much like fostering a hsblt, with ons big sddsd 
problca ~ ths eaotlonal ^Is^nslon. One cpuld fostsr s glvso sttltuds in s 
^ studUmt If could arrsags tbatt for as long aa It takaa: 



a) ha ba rs«ln4,ad aotlvatad to carry ovi tte daslrad babavlor 
Vhanavar he Is confronted with (or, IdeAly, even thinks of) the 
"object" of hia attltij^e, > , , ' 

^ b) he be cauaed, aosiehoir, to ha^e a dealrable esKitlonal reMtlon, 

and c) lie Inatantly get aoM reward or satlafactlon. 

Coi^arlaon of thesis steps with tte recipe for fostering hablta, above, will 
ahov the added problssa poa^ by the eaotlonal' dlMnslon. Many praetitloimra» < 
unfortunately, have ali^ly given up and decldiMl to settle for a chaise in habitat 
Happily, othera are developing vaya of arranging circunst«Kes vhlch will at 
leaat Mxlaiae, if not guarantee, the chance that the participating isdivldual 
will be afforded the experiencea called for by the recipe for foatering attitudea. 
For exas^le, a highly prestigious person (to .the learner) can ai^ply both the 
motivation and the aatiaf action Involved and aodel the dealred behavior. Eliciting 
the poail^ive cnotlonal reaction nay call for further arrangesenta. * 




ERIC 



-16. 38 



EVRUIIJING CISHJS 



PmtTho: j^MJUATOR's Handbook 



BMcarch Section 
SUPERnrrEHDEHT OP PUBLIC IHSTRIICTIOH 
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Pm Two: EmiMTDR's Hmoook 

I. 89fB DEFIHITICHIS 

(la tmtwm of thm 
TMchtrU Tammqr) 

A. Coals mai Obi^t±v%m 



M odwratioQal goal or objoctivo io an Intntt to ctumgo btfurrlor frai 



Tho dMirod chanto, tbta, aay b« tbo^ht of m tho dif botwom 

'liofon'* and ^'aftM*' (or, alf^raieally, ^aftor,** aiiiM **bafora," or arb). 

* • 

If thaa, for axaspla, you wmt your laarMr *^aftar** laamlat **to ba abla ' 
to OKpIalu nair activltiaa,** don*t iforry about meb abUltiaa fa 

a. tha ability to apaafc Eugliah, 

b. tte ability to ataiid up, or awu 

c. tim ability to^undarataad tha oav iMtlvltlaa. 

FraauMbly thaaa ulll hava baaa praaaut both **bafora** nd ^'aftar*' (If, 
l]idaad,t.l^ ara aaaautlal at all). Tha only ability to ba addad la **to 
aaplala This uadoubtadly luvolyaa a aarlaa of at^ga, rad la a 

akUl. 

Bafora, during, or aftar isolating tha cham^a , l.a., tha raal objactiya 
(aa dlacuaaad abova) , ona vill vant to daelda nhathaf it la an ability . 
or a tandaney. In tha axaq^la in it aaana that ona haa already 
latelad hit objaetlya Uk '^ability,'* and ainea it tuma out to ba a akill, 
tha tantativa labal vaa corrdct (aaa Taachar'a Handbook , paga 6) • If tha 
objactlva had baan vord^ ^^to laam to axplaln nav actlyttlai,** . it vmild 
atlll naad tha elaaalffeatlon **ablllty," vhlch la,aafily a^m to a>ply. 

Although I cannot ^dLnk of an axai^la, I auppbaa an objaetlya could turn 
out to ba a coad>inatlon of an ability and a tandancy. If ao, tha two 
coi^onanta ahould ba aaparatad. ^ 



**bafora^ to **aftar^ by iny^dii« ladming; 
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B. Otttcoaes 

B-1. An 4ucatlonal outcofyie £$ the actual change in behavior which was brought 
about through learning. Ideally » perhaps » this would match the intended 
changa txpressed in goals and objectives before the learning (see A~l). 

p^2« Just as a goal or objective is a difference (see A-2)»'So an outcome 1^ a 
difference. 

♦« 

B-3« Liikavlse» \n contemplating a stated outcome such as (to pursue the example 
io^ A»3) ^1 am now able to explain new activltiea/* one should Ignore the 
aspects present both before and after the learning experience, e.g., 
a* the lAllity to speak English, 
: ^ b. the ability to stand up, ^ 

'and c. the ability to understand the new acltivities. 

The ^stated outcome is the newly acquired ability to explain . Such a 
statement requires confirming data. 



C. Memories 

Cr-l. The category **Memorle8" is really a practical category. That is, it is 
not theoretically compatible with the rest of the Teacher's Taxonomy, 
and items in this category need to be re^-cast to fit into other categories 
when any analysis is done. But in practice the device "for the first 
time in my life I ..." elicits much valuable but fugitive data. Dealing 
with thlflT data invtflves certain. steps. 

C«*2* First, one c *8t decide whether the learner's statement 
a. describes one or more actions he took 
or b. describes a change which took place in him. 

0^3 0 If the learner's statanent is strictly a description of one or more 
actions he took, the learning product established thereby is at least 
the knowledge, ^*I have taken that action in that* setting." It may be 



ERLC 



-2- 



Mfe to prasuae some other learning outcones from the fact that the 
leaner has* had that experience, but the learner *8 stateMent does not 
constitute evidence of those outcomes any more than evidence that the 
learner saw a certain movie constitutes evidence that he learned any 
certain thing from the movie. One needs more data in order to ^ 
certain; one does have a c^ear lead to such data. This may be the 

jirlncipal value of the response 4' 

/ . . * - • ' • 

C«-4. TBis' learner 'Statement simply describing' one or more actions he took, in 
Mme cases may be evaluated in quite a different vay. The mmory itself 
may palpably have a value In itself — in terms jof beauty. Interest, 
significance, etc. That is, it %^uld se«m that the meMry is worth 
recalling from time to time for its own sake. E»mq>les are easy to cite: 

a. A blind child reports having run for the first time. 

b. A little girl reports holding a snake for the first time. 

c. A little boy reports having been away from home and 
parents overnight for the first time. 

d. A young person reports having watched the sun rise for 
the first time. 

Such memories are, of course, knowledge (see Teacher's Handbook, Table I). 

C*S. If the learner's statement describes a change which took place In him as a 

consequence of a learning experience, the change may be any of three kinds: 

a. A change in behavior - in what he is able to do. This 
clearly is a lead for evaluation in the "ability" 
category. Data is needed in order to follow up the 
lead. The learner's statement may include his report 
of such data. 

'b. A change in behavior - in what he tends to do. This 
clearly is a lead for evaluation in the "tendencies" 
category. Hera again, data is needed in order to 
follow up the lead. Again, too, his statement may 
supply some data. 

c. A change in feeling about someone or something, i.e., 
a report that same "object" elicits a feeling or 
emotion it didn't elicit before. This is evidence 
of an attitude change. If the new feeling«-*reaction 
is accompanied by a change in overt behavior, this 
is obviously a change in attitude (see Teacher's 
Handbook s page 11). 
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But feelings are facts* and the Teacher's Taxonosy 
racogniaes internal reactions such as nausea* the 
sudden tightening of the stomach » the^djapulse to veep* 
etc., etc., as behavior. For sone of chis behavior, 
the only valid observation Is subjective. For sose, 
science has developed measuring instruments, tech- 
niques, and units nhich make objective (if indirect) 
obaervation possible. A statement that says or 
implies that a person nov has different feelings about 
s o ma o i»s or somethii^ because of a learning experience 
is direct observational (i.e., hard) data regarding 
the formation of an attitude. It vould be difficult 
to c(»Keive of more direct or clear evidence of a nev 
attitude. 



II. A GLASSmcmOH SCBQIE FOR DAXA ON LEAENIH6 

The evaluator of a learning experience deals , primarily with two kinds of 
data~ 

a. Data about the learner's level of achievement C^how much he 
knows, for exa^ile), the learning "possessed.*' 

b. Data to show vliether he acquired that learning because of 
the learning experience in question or otherwise. 

Data of either of these kinds may be direct evidence, indirect evidence, 
a lead to evidence, or simply a report of an experience which has been enjoyed 
by the learner and which suggests the presumption that evidence must exist. 
This is all true* that is, if you define your terms correctly. "Direct evidence" 
is a reik>rt that sorothing has happened. If I report that a boy has Jumped a 
five foot fence, that is direct evidence that he possesses that skill. A test 
scorte ^s tftlrect evidence. Indirect -evidence ic a report that aometh^ng han 
happened irtiich very probably wouldn't have happened if the event in question 
hadn't happened. If you report that that boy won the high Jump event over one 
who Jumped five feet, that is indirect evidence that our hero Jumped over five 
feet. In fact, the boy himself could give either direct or indirect evidence 
of his achievoient. ^t if he simply says "I can Jump over five feet high," 
that is merely a lead. It points the interested evaluator in the direction 
of aome data. Another person's statenent about the boy could be a lead, too. 
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Another kind of evidence, perhaps another kind of lead, is a description of 
an experience vhich the learner has had and nhich, in the Ji^gaent of the 
evaloator, suggests that the learner possesses thti learning or acquired it 
during that experierce* 

Table I susBarixes all of this to show the classification schoe ve are 
soggpetiog for data on learning experiences* 

One cell is crossed out because a description of experience vfalch suggests 
the existence of evidence regarding the possession of learning vould be indirect 
evidence* 

Table I 

A Schsne for Classifying Data on Leamlii^ 



Tjrpes of 
evidence 


li^^urdlng 
acquisition 
of learning 


Bearding 
posMSslra 
of learning 


Direct evidence 






Indirect evidence 






A lead to 
evidence 






A description of 
eiq»erlence vfalch 
suggests the 
existence of 
evidence 







Interpreting Subjective Reports 

Free responses and otbft subjective data are sonetlaes difficult to deal 
vith* The data is too rich for our systems — the sliqilistic little systens ve 
have set up with our nultiple*»cholce items. 

Subjective data can contain elements of all tl^ types si^ested by Table I. 
Questions of the type suggested on pages 2 and 3 of the Teacher's Handbook and 
in the Guidelines ("Parent's Evaluation*') vlll tet^ to fimnel responses into otm 
. of the categories of Table I, but one nust expect a lot of slop«*over* 

the evaluator nay be able to devise questions idiich yield cleaner results » 
but ha should, of course, count the costs in richness* 
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III. SUBJECTIVE lEPOnS OF OTHER LEABHSG ODTCQHES 

As soigMtcd above (Section I-C), subJectlTe reports can mvply the 
•fttlnator vlth various kinds of data. Let us lo^ at the possibilities 
•ystSMtlcally. Subjective reports can yield 

A. Is KBOwledy 

1. lard, direct evidence of possession («.g., the lesmer states 
s fact he has scqulred). 

2. Bsrd, direct eviderce of scqulsltlon; I.e., the lesmer states 
or dearly impliem that he acquired certain knoffledga hecauae 
df » or in the proceaa of » the leamliig activity* 

3e Iiidirrct evidence of poaaeaaion of knovledge. Ihia nd^t he 

fttmiahed, for eneqile, by tht learner* a telliog of adM achieve- 
ment, reciHpiition» or action* 

4e Ev idence iriiicb la leaa hard, bc^canae one cannot be certain of the 
■eaning, hot vAich atrongly siiggeata or veakly deaonatrates 
pMaeaaicm and/or acqulaition of knowledge aa a conaequoice 
of the leandog experience* 

5* A clear lead to evidence of acqniaition of knowledge ("I learned 
a lot about administering group tests") • 

6* A clear lead to evidence of posaeaaion of knovledge (T fcnoir the 
capitola of all fifty of the statea^)* 

7. A lead to evidence of acquisition or possession of knowledge 
which ia not very clear but which nay be worth checking out 
(**The session was really helpful**)* 

8* A description of an experience which the learxMsr had (uA recalla) 
idiich auggesta the presusqition that he acquired certain knowledge 
(^X aaw the novie about water pollution**)* Of courae auch deacrip- 
tlons of experience will vary in clarity and the ai^geation of 
presuaption will vary In strength* Tte exanple "I saw the novie 
about water pollution** nay, in certain contata, be perfectly clear 
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and irary stroi^ly suggestive that the learner acquired certain 

pieces of fadovledge. The sarc could be said of the stata^nt 

"I collected and sounted se^Nm different aoths In those thrM days.*' 

la Skill 

!• Indirect evldrace of possession of a skill. If the learner naaes 
the steps or elcsMnts Involved In a skill, this la Indirect evldOKse 
that he can perfom the ddLll. The only possible direct evidence 
Mould be In the realn of langui«e arts (the learner. In his state- 
ment, sonehov aMMmlcates skillfully). 

2. A lead to evidence of possession of a skill ("I can ...**)• Such 
leads vill vary In clarity, and they may or say not be accoi^anled 
by Indirect evldoKce of the possesslcm of the skill. 

3. Direct evidence of acquisition of a skill C^oday I learned to ..."*). 
The evsluator will need further evidence before he can be sure this 
learner possesses the skill, but unless he has some good reason for 

• doubting the learner's word, he should not need wch sore evidence 
about where or vhen the skill was acquired. Of course, these state- 
■ents will vary In clarity, too. 

4. A lead to evidence of acquisition of a skill (**I think that, because 
of this experience, we are a lot better at ...**). 

5. A description of an experience idiich the learner had and which 
attests the presuiption that skill was acquired or enhanced (see A'^S 
re such statenents as they apply to knowledge) . 

Ee nnderstandlng 

1. Direct evidence of possession of understaiding. If the learner's 
stateamit includes an insight or an analysis of which he wo^ld not 
be capable without the understanding in qwstion, this is hard, 
direct evidence of possession of tte understanding, unleas the eval- 
uator has a valid reason for believing that the statssirat originated 
with soaeone else. Such evidence will vary in clarity, of course. 
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3. 



4. 



5. 



Indirect evidence of possession of understsndlng. This vould consist 
of statearats tending to prove that ht can do things (cause things or 
deai idLth things) vhlch he could not do without s«^lng the relation* 
ship In question. For ejottple, likllrect evidence that a teacter 
uoderstrads negative nunbers Is provided by his statesmt that *'I was 
able to show her how to solve the problcu Involving negative nuabers.** 

▲ lead to evidence of possession of an understanding. These would be 
stattsmits saying 9 in effect , such thli^s as 

a. **! see that 

b. ""I understand •••v 

c. 'The relationship la clear between 

The characteristics of swh le^s are discussed under A«6 & 7 and 8-2. 

Direct evidence of acquisition of understanding (**Thl8 made sie see 
that "^Because of this experience I understand **Now I can 

deal with •••9'* etc.) The reader should be aware of the coaaents 
under A-2 and h^3. 

k lead to evidence of acquisition of understanding. This sight be a 
general stateaent that the learning experience was Valuable **help- 
fuly** etc .9 which would suggest follow»iq[> questions to get evidence 9 
or it sight 9 of course, be a high rating on an evaluation scale i[e the 
learning experience. Previous cooarats regarding leads (A-S & 7 and 
B-*3 & 4) apply here as well. 

A description of experience ^Ich suggests the presunption of acquial-* 
tlon of understanding (cf. A-*8 and B-5). 



Direct evidence of increased interest. This would be a statenent 
that the leaner was pursuing the Interest (i.e., performing the 
behavior which constituted the Interest) mote of the tine. 

Indirect evidence of Increased Interest. This might be a statoient 
that the interests-behavior produced more 9 cost more 9 or other indirect 
evidei^e that more time was being devoted to the lnterest«*behavlor. 
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3. Direct or indirect evidence of the existence of the Interest (as 
against the tocrease) > This vould, of course, simply be evidence 
of the existence of the behavior. 

4. A lead to evidence of the existence of an interest. This would be 
soMthlng such as "I like to or "I an Interested in 

This gives no evidence that the learner's behavior actually fits 
the deflnlticm of "interest." It does point in that direction and 
suggests the gathering of «ore data. 

5. A lead to evidence of the increase of an interest. This vould be a 
suggestive coMient such as a statement that a desumstration of the 
interests-behavior vas "very interesting" or "inspiring »^ etc. 

6. Description of an eaq>erience of the learner i^ich suggests the 
presuBption of the developaent of an Interest. An exaaple would be 
"I took a course in aacraae." 

B* te Habits 

1. Direct evidence of the existence of a habit. This would be a state- 
sent saying, in effect, '"Whenever I I ...." . 

2. Indirect evidence of the existence of a habit. If the habit in 
question causes, creates, prevents, or destroys anything, then a 
stateaent that the "thing" is being caused, created, prevented, or 
destroyed would be indirect evidence of the existence of the habit. 

3. Direct evidence of the acquisition. Increase, or decrease of the 
habit because of the learning experience; that is, a statement to 
the effect that as a consequence of the learning experience the 
learner now, more often, or less often does ... whenever he 

4. Indirect evidence of the acquisition or increase (or decrease) of 
the habit. A statement that the "thing" mentioned in 2 above is 
increasing or decreasing would serve here. 

5. A lead to evidence of acquisition (or elimination) of a habit. My 
statement about a learning experience calculated to improve habits 
which suggests that the experience "helped" would constitute a good lead. 




6* A Itad to tvidenct of tho possMslon of a habit; sonothing llko 
'^X mjoy vfan or "I always when 

7. ▲ dMcrlptlon of an oi^orlance of tht Itamer vhlch suggtats the 
prtauttptioA that tha habit was '^Inprovad." For exaapla, a youngs 
star might raport that *^a sovla raally showad hov lapdrtaat it 
la to bniah your taath af tar a aoal" or "Ha ahowad ua hov daagarous 
it la to inOfc in tha straat/' 

Ba Attitudaa 

1. Ditact avidanca of tha axlataaca of an at'tltuda* Thia could ba aithar 
(or both) of two fcinda: 

a. . a aubjactiva atatnant by tha laamar that soma paraon 

or thing tandad to causa an aootional raactlon in hln 
(tha **faaling'* dlnanaion). Thia kind of atatanant 
alom would show tha axiatanca of an attituda (unlass 
it*s untrua). 

b. a raport by the laamer that a person or thing tended 
to cause an overt reaction (the "overt" dimension). 
This "reaction" does not constitute an attitude uxiless 
acGOapaniad by an eaK>tion or feeling (see Teacher's 
Handbook s Table II.) 

2. Indirect evidence of the existence of an attitude. This could also 
ba either (or both) of two kinds: 

a. - a report by the learner that aomeone else had noted and 

coamented upon his reactiona to soae person or thing. 

b. a report by the learner about the effect or effectiveness 
of his dealings with people. Personality, after all» has 
been defined as the sum of one's attitudes. 

3. Direct evidence of the acquisition of an attitude. This would be the 
aamif as evidence regarding possession of the iattltude (F*l) » except 
that it would also have to include something about increase or decrease. 

4. If^irect evidence of the acquisition of an attituda. This would be the 
eaaa as evidence regarding possaasion, too» except that an indication 
of increase or decrease is needed here. 

5. A lead to evidence of the poasession of an attitude. For example "I 
have no preconceived ideas about ..." or "I react atrongly to ...." 
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A 1««4 to Mrldwet of tho tequltltioa of an attitude. This could 
bo aaything Itko "This oxporlouco changod my ifholo point of viewr 
about 

A daacrlption of axptr^ianco vfaieh auggoata tha praauvption that the 
learner haa acquired an attitude. For exaaqiilet he might say "I 
b<MiaM Involved in a aeriea of wetlnga about atudents' rights." 
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CBAPTER III 



THE FACTOR 0? ORGANIZATION IN LEARNING • 

As stated In Chapter I, the hypothesis imderlylng this 
thesis la th&t reading a set of questions, the point of view and 
organization or which are clear and simple, will facilitate the 
comprehension and increase the retention of the content of the . 
passage covered by the questions. Moreover, the hypothesis 
Buggests ^that such a set of questions will produce greater ooq"^ 
prehension and retention thsn an otherwise equivalent set of 
* questions lacking any clear organization or unitary point of 
▼iev# Since the hypothesis has not been experimentally tested 
as a whole, support for It .must consist of an argument" the steps 
Of which have support from experimental evidence* Hence the 
evidence assembled in the present chapter concerns the validity^ . 
of the following two statements: 



2. Once the orp^arlzation of one body of msterlal Is grasped^ 
a new body of r.&teri&l In Vfilch \he lerrner recognizes the 
s^re orf^rr l^rtlor vl U be rorr readily learned then It, would 
h^v« b'^-^rt V^*^^'l 1?' ' vr'V\r^''?> ^'•'''^rl enc^ . '"h't tne 
process of or-anl:lnp mfiorlr.l to be le^irned can be, el l«ast 
irrrely, - X'^t'^'i h^forv"^ th?^ --^^tTl*! 1? 9^*f>n, by np^ns of 
seelnfr tne orr:anl zfi tion in otm*r maLerlal tind then trans- 
ferring Rrano' of the organization to the new situation. 

It will be seen that the two statemnnts constitute an argument 



1. The ar.ount ccraox^nended and retained from a piece of 
material by a learner in a frlven Derlod of time increases 
with the learner* s Increased ease in arriving at an organi- 
sation of the material. 



66 





6? 

for the hypotheafla and that evidence supporting them would con- 
stitute evidence for the hypo thf sis. 

\ •.Learning" and "Organization" Defined 
Before the evidence supporting the foregoing etatements 
, can be clearly discussed, definitions of' •learning" and "organl- 
. latlon". must be given which indicate the meanings here Intended 
by those terms. 

The term •learning" 1g used widely today and With little 
dlecrlBlnatlon. As a consequence. It has many referents which 
are frequently confysed. In order that the meaning Intended In " 
the present dlecuselon nay be cletrly Identified, an attempt wlU 
be made to 1}J^ the various types of behavior commonly termed 
•learnlnc:" and tc indicate those types to *4ilch the tena le in- 
tended to refer In the discussion that follows,. 

Varlooa common neanings of the term * learning" may be 
differentiated and related accorf^lng to the following outline: 

Learning 

Accui>:ltlon of bc-havloral tendencies 

1. habits 

2. attitudes 

3. Interests 
etc, 

DevelO'-nent of Skills 

« ^ 

la of non-ii i - ul lie jx ricnce 
2a of llnnJl'^'tlc exnerlence 

Comprphenslon 

la Of non-llnpulstlc experience 

a* Idertlflcfltlon of Individual phenomena (objects, 
evente, attributes, etc.); Involves recognition 
of elmll^irltloB between Identified phenomenon and 
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• phenomena of orevlouB exT>erlence> to the end that 

a name or qualifying tera.can be aoplled to the 
phenornenon, a use can be made of lt> 'etc#~a func- 
tion of the learner's experience and hl8 ability 
to ldef;tlfy fanlller attributes* 

perc>: tlon of rein tlonshlDa among a oerlee or group 
of phenoirena--a function of thn learner^e experl- 
cnce> his a:mity to Identify familiar attributes, 
and his oblllty to attribute relations to various 
phenomena Id a prnup or series. 

0. Induction or deduction fro© a, series or group of 
. phenomena — a function of the learner's experience, 
his ability to Icjeiaify faclliar attributes, 
ability to attribute relations to various phenomena 
in a group or Geries, and' ability to moke inductlona 
or deductions* \ 

d. Interpretation i^nd evaluation of a group or series 
of phenomena in the 'light of previous experience 
(IncluGlnr linguistic experience) as In watching a 
football came-— a function of the learner's experi- 
ence, hi? ability to identify familiar attributes, 
his ability to make Inductions, snd his ability to 
relate past and current phenomena. 

' 2. of llnp:l8tlc expp^rience 

a. understandinr of individual words or phrases — a 

function of the learner's vocabulary and experience. 

b* underetAndinp of the mpanincr denoted by a passage, 
i.e., by n fielectlon lopfirer th^n a word or .phrae^— 
a function o:^ the lor^rner's vocabulery and experi- 
ence and his ability to Interpret gramniatlcal 
structures. 

^ c. Induction or deduction on the basis of various 

parts of the Dassacre — a function of the learner's 
vocabulary/ and ex-^rrlence, his ability to Interpret 
grafcmatical structures, and his ability to make in- 
duct^ ^n-- 0^ *, '.T , er t:i'^ case, ripv'be. 
d. int'^rnr^^tatlon and evaluation of material In the 
light of previous oxporlence (including ItK^istlc 
experience) — a function of the learner's vocabulary 
and eK^*^rfence, hie ability to oake Inductions or 
■ deductions, and hie ability to perceive relation- 
shlpK^ b'^tweon current and .fst exoerlence. 

. 

' A f'''..' rv- iT' ,-i,Try i>-- ?. r*"" r,'; Ml'f bo nr:io -nboat the for**- 
goint^ o'jl-llne.' S'.p.co It *a3 oro; re'd noley to clarify tlie -jresent 
dl8CU9fllon and 6lr.ce this dlscuar.ion is very little concerned with 
the acqulflltior of behavioral tendencies or the development of 
eklll, those areas of behavior were not ftnalyzed. On the other 
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hand, thle discussion Is concerned with comprehension and 
' ■•Borlsatlon of Ingulstlc experience, particularly through 
reading. Therefore, It was deemed Important to distinguish, 
flratt between memorization and comprehension of llguletlc ex- 
perience (i.e., experience through Interpretation of symbola). 
Purtherraore, it seemed important to distinguish the various 
possible levels of comprehension in reading. 
^ ' k hypothetical example will help to clarify the levels 

of comprehension of linguistic experience* Suppose that four^ 
subjects read the same passage and comprehend it at the four 
levels described. Suppose, then, that they are asked for a 
deacription of the material. The subject who comprehends at 
the lowest level might reply that the passage was *all about 
boats and pieces of lead and water and stuff, • The reader who 
comorchendB at the second level might describe the paasage as 
•eyln^ that a man put a ball of lead- foil into water and it sank 
and that he then molded the lead f6ll Into the shape of a boat, 
put it on the water, and that It floated. The third subject 
mU(nt say th?>t the writer ohowed th?t the shape of a piece of 
material, as well as its weight, determines whether it will 
float in' water. The reader who read at the highest level of 
comt^reheneion mlrht rpport th^t the passage described a class- 
rpon exo'^rl-'^rt de^ :5:intrptlricr " relil^- edes^ orincl:^le. 

Several facts about the outline should be clarified by 
the hypothetical example. First, It should be clear that the 
example involving reading could readily be converted into one 
involving hearing a lecture, speech, or broadcast. Second, it 
fhould be apparent that although the levels of coniprehension can 
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be dletlngulahed, degrees of comprehension may ▼•ry greatly 
Within level. Third, It should be obvious that the sub- 

jeote eihlblted not only cooprehenalon of the material but also 
retention of It. Thle Is a common characteristic of all reading- 
test responses. 

the first and second levels of comprehension should not 
be confused with niemorlzatlon. A test response exhibiting reten- 
tion devoid of understanding would consist of a parrot-lllce repe- 
t^tlon.of words used In the passage or a recognition of them, ae 
ft aultlple-cholce test. I^ra phrasing would not be found in 
- /eueh a response. A subject whose retention was perfect would be 
-__*ble to reproduce the entire passage verbatim, but, if he did not 
understand any of it, the ^rde, would be merely sounds. As will 
be shown by ev?.dence to be reviewed later In this chapter, memori- 
sation completely devoid of understanding Is psychologically Im- 
possible. 

After the analysis of the comprehension of linguistic 
. experience had been drawn up, coatprehenelon of non-llngulstlc 
experience was analyred. An attenpt was made to follow the 
pattern- of the analysis of linguistic experience, to see whether 
comprehension of non-llnpulstlc experience also fell Into four 
levels .conosrable to the*level<^ of co.-ipreher.slon of linguistic 
i»y---T»4 ^rvr»p ^ TM f? at*-^ ^ • or Ih^ t^«'>ry that conorrhen— 

el^n of lln^^?Vstlc ex-^^ri^nc^s Involve? processes slF.llsr to those 
in comprehension of non-llngulstlc experience, and the attempt 
• i^eos to have been successful. Conseqi*ently, the task of deriving 
gen'»rall2atlons which will apply to both types of comprehension 




Im grieatly facilitated. That Is not to say that by the process 
of definition a paycholOBlcal sioilarlty has been eBtsbliehed 
between the •comparable" levels of conprchenslon of linguistic 
and non-llngulstic experience. For the present, such a alollar- 

ity Is n^i«ely posited. It will be dealt with oorc fully In the 

i 

eouree of interpreting the findings of the present study. 

Another hypothetical situation slrould clarify the mean- 
ingfli Intended by the four levels of conprehenslon of non-llngulstig 
experience. Suppose that four subjects, of four levels of ability 
capable of the four levels of comprehension, enter a hotel lobby. 
Subject number one, comprehending on the lowest level, might see 
a chair and, recognizing the characteristics of that object 
•imilar to those of objects previously encountered, express his 
recognition of it as a chair either by saying the word "chair' 
or by sitting on It. Likewise, he might express recognition of 
food, water, elevators, dogs, fights, running (by a bell hop), 
etc., by naming them or reacting appropriately. The second sub- 
ject wight express p>erceptlon of relations among Phenomena ex- 
perienced by inltftlnr nn-iqonc's ^resr^lns^ of a button In order 
to hear the sound of the chines which delighted him, by moving a 
piece of furniture which blocked a door he wished to open, by 
inltetlvely- turnln-7 off £ light, etc. The cubject con'.rjrehendlng 
at th*^ thlr:"! I'-vel rilfht sxpre?': Incuctlors --nc dedi:ctlor.s fr^T. 
his observations by concluding thtt the desk clerk was In con.K&nd 
of the lobby because everyone, staff and guests, seemed to follow 
his directions, or by concluding that the hat-check girl was 
selling hats. A sophisticated subject introduced Into a hotel 
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lobby Would comprehend at the fourth level, finding the lobby an 
flnLjr relatively novel situation, and behave In a •noroal* manner 
on the basis of his previous experience vlth similar situations. 
Recognising the cigar counter for what It was, he sight pur- 
ehaae a cigar and newspaper and proceed to complete the observa^ 
tlonal period In a comfortable chair. Vhlle doing so, he might 
note the. fact that people entering wore i«t raincoats and remark 
timX It seemed to be raining outside* 

One conclusion suggested by this examole la that although 
oosprehenslon of li^lstlc experience Is strictly human behavior, 
ttm two lower levels, at least, of comprehension of direct ex-> 
perlenoe could be carried on by sub-human subjects* Ihls, hov-> 
ever, does not necessarily destroy the T»rallel which has been 
poelted. with the exception that linguistic experience Is ex- 
cliBlvely human behavior, the four levels of comorehcnslon of 
^%w^exp9.ri.Bnce are comparable to the four levels of conprehen* 
alMi of -YlrprlniiP experience. In other words. It seems likely 
that a subject capable of any given level of comprehension of 
'«Hfc*ect experience would, given ability tc handle sjabols, bs 
capable of the comparable level of comprehension of vl^airtotia 
experience. 

It should be eaiTihaalzed thi t the outline and subsequent 
discuFol.iri f..-iv«: r-'Sfr.tcd ccf lr.1 1 1 .r.-:? of Irrrs, experlrr,-rtr.l 
evidence. If the reader edrrlts the exlFter.ce of the various 

types of behavior described and the presence of distinctions 

» 

between thote verlovs types, the object of the outline end dls- 
euseion is achieved with the labelling of the various types of 



n 

M^nor. The only mom for crttlclaa of the outline le its 
iapllcetlon that It eabrecee ell of the aejor areas of huaan 
behavior commonly referred to ae •learning." If auch a aajor 
mrm of behavior has been neglected, the outline la Inadequate 
to tiiat extent by Implication. To repeat, the purpoae of the . 
oatUne ie elmply to clarify discussion. 

In the ensuing discussion, the term "learning" will be 
avoided wherever a more precise term can be employed. When 
"learning" Is used without quotation marks. It will refer either 
to kll of the forms of behavior suggested by the term or to a 
foTB of behavior within that area whlOh some Investigator under 
roTlev has not defined clearly enough so that a less general term 

■ay be applied. 

■Organization," according to Webster's Collegiate 
Pictlonary , Is "the act of arranging or constituting in Inter- 
dependent parts, each having a special function or relation with 
respeot to the whole." This recognised conraon usage of the term 
Should suffice for the purposes of the present discussion If It 
Is understood th«t the arranj^e-nents, functions., relations, etc., 
■ay be logical, temporal, or spatial or musical. Two corolUrles 
of the definition will receive greatest emphasis: (1) organiza- 
tion Is an active process, end (2) it consists of establishing 
relations amnp neubers of the fTrour> or series organized. 

Orprrnl7«9tlon and Co'rrrp*'enslon 
The first task In the support of our hypothesis Is to 
•hov that the saount cooprehended and retained froa a piece of 
■aterlal in a given period of time Increases with the learner's 



